Statistical Mechanics
Table of Contents
1. Microstate
- \(\psi_i\)
Because all \(\psi_i\) are indistinguishable, they are equally likely to occur.
2. Ensemble
2.1. Micro-Canonical Ensemble
2.1.1. Definition
- The set of all microstates with the same energy.
- \(\Omega(E)\) is the number of microstates in a micro-canonical ensemble with energy \(E\).
2.2. Canonical Ensemble
- A system in thermal contact with a heat reservoir.
2.3. Grand Canonical Ensemble
- A system thermally and molecularly open to its environment.
3. Macrostate
- Many microstates belong to the same macrostate.
4. Boltzmann Distribution
- Named after Ludwig Eduard Boltzmann.
- Probability distribution of microstates, given macrostate under thermal equilibrium.
- Thermal equilibrium is achieved when the probability distribution becomes time independent.
4.1. Derivation
Let the closed system \(\psi_i\) have the energy of \(E_i\), and the system is within the environment with the energy of \(E_{\rm env}\). The total energy is \(E_i + E_{\rm env} = E\).
\(P(\psi_i)\) is proportional to the number of microstates of environment \(\Psi_I\), consistent with \(\psi_i\). \[ P(\psi_i) \propto \Omega(E_{\rm env}) = \Omega(E - E_i). \]
Taylor expand at \(E\), then truncate it under the assumption \(E,E_{\rm env} \gg E_i\) \[ \ln\Omega(E-E_i)\sim \ln\Omega(E) - \frac{\partial \ln\Omega}{\partial E}E_i. \] Therefore, \[ P(\psi_i) \propto \exp\left(-\frac{\partial \ln\Omega}{\partial E}E_i\right). \] We here introduce: \[ \beta = \frac{1}{k_{\rm B} T} = \frac{\partial \ln\Omega}{\partial E}. \]
Finally, \[ P(\psi_i) = \frac{1}{Z}\exp(-\beta E_i) \] where \(Z\) is the normalizing factor called partition function, which is the sum of Boltzmann weight of every state.
4.2. Open System
- \[
P(\psi_i) \propto \Omega(E-E_i, N-N_i)
\]
- The Taylor expansion then becomes \[ \ln(\Omega(E-E_i,N-N_i)) \approx \ln(\Omega(E,N)) - \frac{\partial \ln(\Omega(E,N))}{\partial E}E_i - \frac{\partial \ln(\Omega(E,N))}{\partial N}N_i. \]
- Introduce the chemical potential
\[
\beta\mu = - \frac{\partial \ln(\Omega(E,N))}{\partial N}.
\]
- Negative sign is included to make the particles flow from the higher potential area to the lower potential area.
- It is more negative when the entropy is more variable per molecule transfer.
- Finally, \[ P(\psi_i) = \frac{1}{Z}\exp(-\beta E_i + \beta\mu N_i) \]
4.3. Multiple Chemicals
- \[ P(\psi_i) = \frac{1}{Z}\exp(-\beta E_i + \beta\sum_j\mu_j N_i^{(j)}) \] where \(N_i^{(j)}\) each represent a unique chemical.
5. Entropy
\[ S := k\ln \Omega \]
5.1. Gibbs Entropy
6. Temperature
- It tells how little the entropy changes due to the change in energy.
6.1. Definition
\[ \frac{1}{T} = \frac{\partial S(E)}{\partial E} \]
7. Free Energy
7.1. Helmholtz Free Energy
7.2. Gibbs Free Energy
8. Partition Function
8.1. Definition
\[ Z = \sum_i \exp(-\beta E_i) \]
It contains the information of all the microstates available at thermal equillibrium.
\[ Z = \frac{\Omega(E)}{\Omega_{\rm env}(E)} \]
9. Macroscopic Quantity
- Macroscopic quantity is the average of microscopic quantities within the ensemble.
- \[ X \equiv \langle X_i \rangle = \sum_i P(\psi_i) X_i \]
9.1. Number
9.2. Internal Energy
9.3. Pressure
9.4. Energy
- When we do not care about \(N\), we can set \(\mu = 0\).
9.5. Energy Fluctuation
- \[ \delta E^2 = \langle E_i^2\rangle - E^2 \]
- \[ \delta E^2 = -\frac{\partial^2}{\partial\beta^2}\ln Z \]
10. The Law of Thermodynamics
10.1. Zeroth
Energy flows from the higher temperature to the lower temperature.
It is due to the entropy in the lower temperature part increases faster than it decreases in the higher temperature part.
10.2. First
- \[ dE = TdS - PdV + \mu dN \]
10.3. Second
- \[dS \ge 0\]
10.4. Third
- \[ T = 0 \implies S = 0 \]
11. Virial Theorem
11.1. Derivation
Let us define the "radial momentum" \( G \), from the "central moment of inertia" \( I \):
\begin{align*} \frac{1}{2} \dv{I}{t} &= \sum_k m_k \dv{\vb{r}_k}{t} \vdot \vb{r}_k \\ &= \sum_k \vb{p}_k \vdot \vb{r}_k := G. \end{align*} \begin{align*} \dv{G}{t} = 2T + \sum_k \vb{F}_k \vdot \vb{r}_k. \end{align*}When averaged under the assumption \[ \expval{\dv{G}{t}}_{\tau} := \frac{1}{\tau}\int_0^{\tau} \dv{G}{t}\dd{t} = \frac{G(\tau) - G(0)}{\tau}= 0 \] which is the case for bounded system, the virial theorem is obtained: \[ 2\expval{T} = -\sum_k \expval{\mathbf{F}_k\vdot \mathbf{r}_k}. \]
11.2. Special Cases
Using the Newton's third law of motion, after decomposing the force into force on \( k \)th particle by \( j \)th particle \( \vb{F}_{jk} \): \[ \dv{G}{t} = 2T + \sum_{k > j} \vb{F}_{jk} \vdot (\mathbf{r}_k - \mathbf{r}_{j}). \]
If we assume that the force \( \mathbf{F}_{jk} \) can be given by the potential energy \( V_{jk} \): \[ \mathbf{F}_{jk} = - \nabla_{\mathbf{r}_k}V_{jk} = -\dv{V_{jk}}{r_{jk}} \left( \frac{\mathbf{r}_k - \mathbf{r}_j}{r_{jk}} \right), \] it gives
\begin{align*} \dv{G}{t} = 2T - \sum_{k > j} \dv{V_{jk}}{r_{jk}}r_{jk}. \end{align*}11.2.1. Power-law
If \( V_{jk} = \alpha r^n_{jk} \), \[ \sum_{k > j}\dv{V_{jk}}{r_{jk}}r_{jk} = n V. \]
\begin{align*} \dv{G}{t} = 2T - nV. \end{align*}11.2.2. Lagrange's Identity
When \( V_{jk} = \alpha r_{jk}^{-1} \), \[ \dv{G}{t} = 2T + V. \]
In a bounded system, it simplifies to: \[ \expval{T} = -\frac{1}{2}\expval{V}. \]
11.3. Applications
- In astrophysics, it is used to tell whether a star will expand or shrink.
12. Phase
12.1. Allen-Cahn Equation
\[ \pdv{\eta}{t} = - M \frac{\delta E}{\delta \eta} \] where \( \eta \) is the scalar-valued state variable of fluid with \( \pm 1 \) indicating both domains, \( M \) is the mobility representing the rate of change of domain, and \( E \) is the total energy of the system. The total energy is given by: \[ E[\eta] = \int_{\Omega} F(\eta) + \frac{\varepsilon^2}{2} \| \nabla \eta \|^2\dd{\Omega}, \] where \( \varepsilon \) controlling the relative contribution of potential energy and interfacial energy, \( F \) is the potential energy, often given by \( (\eta^2 - 1)^2/4 \).
12.2. Cahn-Hilliard Equation
\[ \pdv{\eta}{t} = - D \nabla^2 \frac{\delta E}{\delta \eta} \]
The total volume of each phase is conserved due to the conservation law \[ \pdv{\eta}{t} = - \nabla \cdot \mathbf{j} \] where \( \mathbf{j} = -D \nabla \mu \) in which \( \delta E / \delta \eta \) is identified with chemical potential \( \mu \).